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In this report, the circularly symmetric model is 
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In addition, it is shown how maximum likelihood estimators (HLEs) and 
likelihood ratio tests CI<RTs) can be obtained. The circularly 
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TESTING AND ESTIMATION FOR STRUCTURES 
WHICH ARE CIRCULARLY SYMMETRIC IN BLOCKS^ 

Ingram Olkin 

Stanford University and Educational Testing Service 
1 . Introduction 

There has been considerable study of models in which the observations 
arise in a structured form. These structures may yield covariance matrices 
which exhibit special patterns or symmetries. An early example of patterned 
covariance structure is the intraclass correlation model (in which all the 
variances and all the covariances are homogeneous) considered by Wilks 
( 1946 ). Another example is the spherical model in which all the variances 
are equal and the covariances are zero. A wide class of structured models, 
called radex models, was introduced by Guttman (1954). In these models, 
test scores are generated from components which may be viewed as having a special 
geometrical structure, and hence the more recent name simplex models. 

Although Guttman (1954, 1957) provided examples of data which approximated 
simplex structure, there was little work in developing estimators of the 
parameters or in designing tests of hypotheses. The paper of Wilks (1946) 
was concerned v/ith inference for the particular intraclass correlation 
model. This model has now been studied in some detail in various contexts. 
Similarly, tests for sphericity also have been studied in detail (for 
references, see Gleser, I 966 ). 

The first general study of some simplex models was that of Mukherjee 
( 1966 ), in which solutions of the maximum likelihood equations are dis- 
cussed. In a subsequent paper, Mukherjee ( 197 O) was able to obtain explicit 
maximum likelihood estimators for a certain class of simplex models. 

^Supported in part by the National Science Foundation Grant 32326X 
at Stanford University and by Educational Testing Service. 
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AnotJier general paper which has relevance to some of the Guttraan's simplex 
models is that of Anderson (1970)* The method of analysis considered by both 
Anderson (1970) and Mukherjee (1970) is based on covariance matrices E which 
may have a representation of the form 



(1.1) . Z = 0,At + ... + Q A„ , 
' 11 mm 



where the matrices A. are known and the 0's are unknown. Many patterned 

t) 

covariance matrices may be expressed in the form of (l.l). j3reskog (1970) 
provides a general discussion of the solution of the maximum likelihood 
equations for simplex models . 

Although general methods were considered in these papers, greater 
depth can be achieved in the study of some particular patterns. One 
such pattern, called the circumplex by Guttmar^ was considered by Olkin and 
Press (1969), in which an extensive study was made of a hierarchy of models. 

In addition to studying the covariance structure, patterns among the means 
are also considered. Olkin and Press provide not only the likelihood ratio tests 
of various hypotheses, but also different approximations to the null and non- 
null distributions. It is of interest to note that the genesis of their 
study is a physical model in which observations are made at the vertices of 
a regular polygon. Because of stationarity [see Olkin and Press (19^9)]^ S- 
circularly symmetric model is generated, which is identical to that of the 
circumplex. 

In the present paper we extend the circularly symmetric model to tiie 

» 

case where the symmetries are exhibited in blocks, and show how maximum 
likelihood estimators (MLE) and likelihood ratio tests (IRT) can be obtained. 
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2 . Preliminaries on the Circularly Symmetric Model 



Before providing an extension of the model, we first reviev; the cir- 
cularly symmetric model, and show how the redixction to a canonical form 
enables us to obtain easily the MLE and LRT. In both Guttman's circumplex 
model and in that considered by Olkin and Press (1969), we have random vari- 
ables with means and covariance matrix , which is 

a circular symmetric matrix. A circular symmetric matrix A is given by 



( 2 . 1 ) 



A = 
c 
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, where a^. = > i = 2 ,...,r 



Every symmetric matrix has a representation 

(2.2) A^ = r’D^r ,, 



where are the eigenvalues of A^ , = diag(xj^, . . *,t^) , 



and r = (7. ) is orthogonal 

JK 



A key point in the development is the fact that if A^ is circularly 
symmetric , then 



(2.5) 



■"j = ■"r-o+2 ^ 0 = 2,...,r ; 



furthermore, the elements are given by 



= r"^/^{sin 2jtr"^(d - l)(k - i) + cos 2rtr'^(d - l)(k - l)) > 



(2-^) 'jk 

which are independent of the elements of A^ . 
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Another way to express (2.l) [see Wise (1955)^ is 

(2.5) + ... + > 

where 



(2.6) Wj, - I 









Remark 

Since a^ = a^ may combine terms having the same coefficients 

to yield terms •! W^_j^g * '"^r-j+2 “ ^,i ^ ^r-j+2 

symmetric. It is easily verified that W . = W^ , so that all matrices 

(W . + W*.) i - 1 are commutative, and hence may be diagonalized 

J J 

by the same orthogonal matrix. This fact will be used later. 

Suppose we have a sample of size N , * *. *^^p0£^ * a = 1, ...,N , 

from a normal population with mean vector \i and covariance matrix E . 

By sufficiency we may consider the mean vector x , which has a ^^(ii,E/n) 
distribution/ and the cross product matrix S , which has a Wishart dis- 
tribution, ^/(Z;p,n) / n = N - 1 , with density function 

p(S) = expt- | tr e'^S] , 



where 

. 2-P»/2,-p(p- 1)A[ S r( I (n - i . l))r^ . 

Now transform x and S by 
(2.7) y = # xF' , V = rsr' , 






so that 



( 2 . 8 ) 



y~T((v,f.) , V~aP'(f;p,n) , 

where v = mF and £ = TET’ . If E is circular, then E is diagonal,- 
and estimators of the parameters are readily available. 

In the following extension, we make use of these ideas 'co afford an 
analogous simplification for the extended problem. 

3 . Block Circularity 

The extended model may be generated in various ways. In terms of the 
physical model mentioned in Section 1, we again have a point source 
located at the geocenter of a regular polygon of p sides, from which a 
signal is transmitted. Identical signal receivers are positioned at the p 
vertices. However, now the signal received at the i -th vertex is 
characterized by k con 5 )onents, and is denoted by x^ = ^^il^ * * *^^ik^ * 

The main assumption is that the covariance matrices depend only on the 
number of vertices separating the two receivers, so that 

(3.1) Cov(x.,x.^J = E^ = Ep_^ , m = 0,...,p , 

where each E is a k x k matrix. Thus, for example, if p = 4 and 5; 
m 

we obtain 
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In terms of Guttman's circumplex model, , vectors of scores are generated 
from a structured model as follows. For simplicity, consider the special 

case in which there are five tests ^ 2 . > ^2 ^ ^5 ^ ^ ^5 

from 5 components , Cg , c^ , Cj^ , , where each c^ is a k - 

dimensional vector: 




If c. , , c , c, , c_ are on a circle [Guttman 

'1 2 5 T" 5 

rationale for this] , so that 



( 1954 ) provides a 



Cov(c^,c^^j^) = ^ f ^ “ 1>2,...,5 , 

with = ^ , Ag = Aj [because the "distance" from c^ to Cg is that 
of Cj^ to c^ , and the "distance" from c^ to c^ is that of c^ to 
c,^ ], then we obtain (5-2) for p = 5 as the covariance matrix. 



4 . Reduction to Canonical Form 



The critical question at this point is whether a reduction to a canon- 
ical form is possible for the block circular case. Although not obvious, 
by using Kronecker products it becomes straightfosrward to see that such a 
reduction is possible, indeed. 



1 



7 



First we note several facts concerning the Kronecker product 
A ® B 5 (a. 3) . 

If A : m X n , B ; p x q , then A@B is an mp x qn matrix. We would 
like to generate block circular matrices as in ( 3 . 2 ). To do this, the 
matrix we use ( 2 . 5 ) and form 

(4.1) 2 = (Wq<^ Sq) + (Wj^^Zj^) + ... + , 

where the matrices W. are defined in (2.5), and Z. = , 

3 J P”J 

j = 1 , ...,p - 1 . For example, when p = 4 , we obt».in 




Next we need several well-known facts concerning Kronecker products; 



(4.2) (Aj^ ® B^) (Ag ® Bg) = Aj^Ag » B^Bg , 

(4.3) A ® (B + C) = (A ®B) + (A 0C) , 

(A + B) ® C = (A 0 C) + (B ® C) 



(4.4) 



Applying these facts to (4.l), we obtain 

(4.5) (r® I)z(rv® I) • 

= (rw^r* Zq) +(rWj^T' ® z^) + • • • + (rWp_ir Zp_3^) . 

Recall that = I , W = w( , j = 1, •••,? " 1 • Consequently, if T 

diagonalizes * i.e., r(W^ + W^)!'' = diag(c^, . . ., 

then r(W. + W'.)r' = . But the matrix T defined by (2.5) is exactly 

V 3 o' e 

that orthogonal matrix which diagonalizes W. + WJ. , and the diagonal 

O cl 

elements e. are the p roots of unity. Thus 
D 

(4.6) (r® l)Z(r' ® I) = Diag(tj^,t 2 ‘, ***'^p^ - " 

where the matrices t. are positive definite and satisfy 

, J ■, ,, 

(4.7) = Vd+2 ' ' ^ • 

As in the case when the blocks are single elements, we may now use 
(2.6) and (2.7) as our starting point, noting that we have pk variates 

instead of p • 

Remark ; If we wish to recapture estimates of Z^ , we may do so from (4 
namely, 

(4.8) Z = (r* I) D^(r@ I) . 

Indeed (4.8) yields simple linear equations of the form 

('‘•9) , a . , 

where the coefficients a^^ are functions of the 7^^' 



3 - Hypotheses for Symmetric Structures in the Covariance Matrix 
and the Likelihood Functions 

The following hypotheses represent block versions of (l) sphericity, 
(2) intraclass correlation, (3) circular symmetry, and (4) a general motrix 

(5*l) ; Z = Diag(ZQ, • • »,Zq) , 




^1 ••• ^0 

: Z > 0 . 

In terms of the canonical representation, we may now test hypotheses such 
as ' 

(a) sphericity versus intraclass correlation, 

(b) sphericity versus circular symmetry, 

(c) intraclass correlation versus circular symmetry, 

(d) circular symmetry versus general structure. 

Because of the canonical form (4.6), the parameter space for each of the 
hypotheses becomes 



(5.2) £Uj_ = if: f^= ... = > 0 , given '<!r^ = .< 0 = 2, ...,p) , 

= {t: >0 ; tg = ... = >0 , given = ^p.j+2 / ^ = ^^ * * 

0 ^ = { t : \>0 , ^2 = ^ p - d +2 > ° ^ ^ 

= {Z: Z >0) . 

Following the procedure of Olkin and Press (l9^9)f we may obtain the 
maxima of the likelihood functions L(y,V) over the regions cu. and cu. , 
and thereby generate the likelihood ratio tests (LRT) for hypothesis H/ 
versus 

(5.5) 

Because the circular symmetric model is equivalent to the condition 
f^=f, = f , etc., it is clear that we will want to pool th® aor 

w jp ^ jp X 

variance matrices V«o with V „ , V,, with , etc. in esti- 

22 PP 55 p-l,p-l 

mating the common , etc. Thus, it will simplify our notation if 

we write 

(5.^^) (Vi>***>V^i) = ^pp^***''^mm \+2,m+2^\+l,m+l^ ^ 



H by 

J 



>v. . = 



sup L(y,v) 



CD. 



ij sup L(y,V) 



(U. 

J 



when p = 2m is even, and 



(5-5) ' 



when p = 2m + 1 is odd. For later use we define 
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(5-6) V^=Vj+2 ^ 3=2,...,P . 

Since the mean vector y and the V 's are independently distributed, 
when E is circular, we have as a canonical model: 



Mean Vector 



( 5 . 7 ) 



i|r = 
0 



'^P-d+2 



0 = 2 , 



Covariance Matrices 



(5-8) j Vj ~H^y,k,2n) , j = 2,...,m , 

Vl ^ P = 2oi . 

(5.9) ~y(^ 3 ^;k,n) , Vj ~^(t^;k,2n) , j = 2, ...,m + 1 

when p = 2m + 1 

The maxima of the likelihoods may now be obtained in a straightforward 

manner, and to a certain extent, the results parallel those in Olkin and 

Press (1969). The results are based on the assumption that the mean 

vectors v, are unknown. A slight modification in the development 

1 P 

yields analogous results irtien the means are known. 

We now list the maxima of the likelihood function for the various 
models using (5*7) - (5*9) as our starting point. In each case the maximum 
involves a common term 



(5.10) = . 






V 



T 
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Spherical Model 



r-v 



•W/; • 

.•■;f 



(5.11) sup L(y,V) = 



,PkN/2 



(u. 



1 = 1 



pN/2 



I ntrac la s s Correlation Model 



(5-12) 



sup L(y,V) = 
0^ 



c(Y) [M^fo - 












Circular Model 



(5.15) sup L(y,V) = 



pkN/2 



“5 






■> 



General Case 
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(5.14) s^Jp L(y,V) = • 

For each of the hypotheses considered when the hypothesis is true, 
the LRT is distributed as a product of independent beta variates, so that 

the procedure of Box (1949) may be used to obtain an approximation for the 

.2 

null distribution. We here present an approximation to 0(N ) . Because 
some of the hypotheses are closely allied to testing for the equality of 
covariance matrices, the Bartlett modification may be preferable to the 
LRT [see Anderson (1958) for details concerning this test]. Also, because 
some of the hj'potheses are nested, we may use the procedure of Gleser and 
Olkin (1972) to provide an easier evaluation of the needed constants. 

.13 



-15- 



6. Likelihood Ratio Tests and Their Approximate Null Distribution 
for Testing Symmetric Structures 

Using the results (5* 11 ) -(5*15 we may readily form the LRT for various 
hypotheses. In some instances the results for p=2m or p = 2m+l 
differ; whenever possible, we combine our results for even and odd p by 
using the parameter m . 

6.1 Test for Sphericity Versus Circularity 

From (5*11) and (5*15), the LRT, , is given by 



( 6 . 1 ) 



n |v . I 

^2/n _ 1 ^ 

« 2=k(p-m-l) I ^ |P 

1 



The modified Bartlett statistic, , is a simple function of , 

namely, • Using the result of Anderson (1958, p. 254) we obtain 

the approximate null distribution; 

(6.2) P{-p log Lj^j < z) = P{X^ < z) + 0(n"^) , 



where 



f = I mk(k + 1) , 



_ - _ 1 [T3(5m + 3 - p) - 2] (2k^ + 5k - 1) 
” n I2mp(k + 1) 



O 

ERLC 



i. 14 



*T^. C' tv •! -c'jv - ; 
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.14. 



6.2 Test for Intraclass Correlation Model Versus Circularity 
From (5*12) and (5*15), the LRT, , is given by 

(p - n |Vj I 



(6.5) 



,2/N _ 



I 2 V. . P"^ 



11 



f" 

V 



As in Section 6 . 1 , the modified Bartlett statistic, L 25 , is given by 
Lgj = ^23^ • Similarly, 

(6.4) P{-p log L 25 < z) s P{X^ < zl + 0(n'^) , 



where 



f = ^ mk(k + 1 ) , 



_ . _ 1 (5mp - - 3m + P - 5) (2k^ + 5k - l) 

" n 12 (p - l)m(k + l) 



6.5 Tests for Circular Versus General Structure 
From ( 5 . 15 ) and (5*l4), the LRT is given by 



(6.5) 



2/n _ |v I 



'54 



P , 
n |v 

J 



In order to show that this statistic is distributed as a product of 
independent beta variates, note that 
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Ivl 



|V| 



1^22! I^pl 

niv.l n|v..| 



pp 



|v + V „ I 

mm m+ 2 ,m +2 



if p = 2 m , and 



Iv| 



JiL '^22! I^npl 



niv.l n|v.J 



^^r.+3 . m+l^ l\+2,n+2 l 



^^m+l,m+l ^ ^m+2,m+2^ 



if p = 2m + 1 . Under the null hypothesis, these statistics are 
independently distributed. Furthermore, each term is known to be dis- 
tributed as a product of independent beta variables, Anderson (1958# 

Chapters 9# Consequently, we may use the following result of Gleser 

G 

and Olkin (1972): If Z s= II Z. , and appropriate regularity conditions 

1 ^ 

prevail, then 



where 



P{-2 log Z < z] £ P{X^ < pz] , 

G - G 



f = Zf. , p=Z f.p./f , and the f. and p. are obtained by 
1 1 1^1 1 1 



applying the Box procedure to each Z. . 

p 

In the present case, we may let Zj^ = |v | / n | . This is the test 

statistic for testing for independence in a covariance matrix [see Anderson 
« 

( 1958 , p. 253 )]. Here f | k^p(p - l) , p^^ = 1 - [2k(p + l) + 93/6 n . 

The remaining statistics Z^ are of the fom ^ ^^22 ^^11 ^22^ ^ 

which is the test statistic for testing for the equality of two covariance 
matrices [see Anderson ( 1958 , p. 255 )]. For each such test, we obtain 
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= I k(k + 1) , 



, 2k^ + 3k - 1 

Pj ^ 12N(k + l) 

Note that p - m - 1 is equal to m - 1 vhen p = 2m , and is equal 
to m when p = 2m + 1 . Thus, in either case of p even or odd, we 
obtain 

(6.6) ^ ^ " l) 5 (P - ™ ■ l) k(k + ly . , 

p = 1 - (2kp(p - l)(2kp + 2k + q) + (p - m - l)(2k^ + 3k - l)) 

The final approximation to the null distribution is then given by 

p(-p log < z) = P{X^ < z) + 0(N ) , 

where f and p are given by (6.6). 

7. Tests for Means Given That the Covariance Matrix Is Circular 

When the population covariance matrix has no special structure, and we 
wish to test that the mean vector is zero, the appropriate test is 

p 

Hotelling's T^ . However, when we know that there is a circular struc- 
ture, we take advantage of this information in constructing a test. 

From the canonical form (5*7)-(5*9)^ we see that under H: v = 0 , 
we should estimate by + y[y^^ , and we should estimate by 

" ''p-;)-2,p-;).2 " y?;) " yp-j.2yp.,>2 ^ 

j = 2, ...,p . Thus the LRT statistic is given by 



7 



-17- 



(7.1) 



= I 



Iv, 






where when p = 2m + 1 



(7.2) Zi = , Zj = yjyj * y^.j^ayp. 



J.2 



} j — 2^ • • • ^in + 1 ^ 



and when p = 2m , 



(7.3) Zj^ = y^yj^ , z^ = yjy^ * = y;*iy, 



"m+1 



j = 2, ...,m . E«ich coti 5 )onent of the product in (7*l) is distributed as a 
U -statistic [see Anderson (19583 P* 193)]. Thus, we may again use the 
Lemma of Gleser and Olkin (1972) to obtain an approximation to the null 
distribution of the LRT. To do this we need to know the degrees of freedom 
f , and the value of p . For ratios |v . 1/ |v . +Z.| , which do not in- 

tJ J tJ 

volve pooling, e.g., j = 1 , we have 

for terms which involve pooling, e.g., j = 2, ...,m , we have 
f = 2k , p = 1 - . 



Consequently, the overall value of f is 



f = pk. 



[k^ + (k^ - l)(p - m - 1)] 

^ P - 2f(k + iV 
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Remark: The methods outlined lend themselves to the development of other 

tests concerning the means. For example, Olkin and Press ( 1969 ) consider 
the test that the means are equal when there is circular symmetry. This 
model may he extended to test that the mean vectors are equal in blocks, 
when the covariance matrix is circularly symmetric in blocks. Similarly, 
we may simultaneously test for the equality of the mean vectors and 
circular symmetry. The key point in the development of such tests is 
to start with the canonical form (5*7)-(5*9)^ from which the LRT may be 
readily obtained. 
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